Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

feat: get running models #592

Merged
merged 6 commits into from
May 24, 2024
Merged

feat: get running models #592

merged 6 commits into from
May 24, 2024

Conversation

@vansangpfiev
Copy link
Contributor

@vansangpfiev vansangpfiev commented May 21, 2024 •
edited
Loading

issue: https://github.com/janhq/cortex/issues/589
endpoint: v1/models
response example:

{
    "data": [
        {
            "id": "nomic-embed-text-v1.5.f16",
            "object": "model"
        },
        {
            "id": "mistral-7b-instruct-v0.1.Q4_0",
            "object": "model"
        }
    ],
    "object": "list"
}

bump cortex.llamacpp version to support this: v0.1.9

@vansangpfiev vansangpfiev requested a review from louis-jan May 22, 2024 07:09
@vansangpfiev vansangpfiev marked this pull request as ready for review May 22, 2024 07:10
louis-jan
louis-jan approved these changes May 24, 2024
View reviewed changes
Copy link
Contributor

@louis-jan louis-jan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@vansangpfiev vansangpfiev merged commit deb2600 into dev May 24, 2024
@vansangpfiev vansangpfiev deleted the feat/get-running-models branch May 24, 2024 07:53
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

1 more reviewer

@louis-jan louis-jan louis-jan approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@vansangpfiev @louis-jan